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ABSTRACT 



Recent increases in the speed and accessibility of computers 
and networks have made it possible to administer tests on-line. On-line 
assessment can be conducted in a controlled setting, such as a testing 
center, or distributed over local area networks or the Internet to libraries 
and student homes, allowing students the flexibility to complete tests as 
their schedules permit. While on-line tests can contain virtually any type of 
question, the easiest test to develop are true/false, f ill-in-the-blank, and 
multiple choice formats. Advantages of on-line tests include time savings for 
instructors and students, as well as increased learning opportunities for 
students in that the tests offer immediate feedback and do not take up class 
time. There are disadvantages to on-line testing for students, however, 
including the problem of procrastination, the lack of universal computer 
access and skills, and less flexibility in test-taking strategies. 
Disadvantages also exist for teachers, including problems with security and 
computer hardware, and issues related to "debugging" testing programs to 
ensure correct feedback and scoring. Tools for developing on-line tests 
include basic Hypertext Markup Language (HTML) with hyperlinked answers; HTML 
forms with Perl, CGI, or Personal Home Page (PHP) scripts to send feedback to 
students and commercial test development software. Sample HTML and PHP source 
code and test screen shots are included. (BCY) 
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Abstract: Assessment is important, but time consuming, both for student and 
instructor; however frequent assessment provides students and instructors 
feedback on progress towards learning objectives. Instructors can develop 
on-line tests that provide immediate reinforcement, mange scores, and 
support a range of student learning modalities. This paper, which was 
designed to supplement my talk, provides an overview and references on 
how to obtain and use software tools to develop and deliver on-line 
assessments for your students. 

Intended audience: this paper was written for community college instructors. 

All examples of tests from this paper can be found at 
<http://www.imagenmm.com/testing/>. Feel free to experiment with these 
examples, borrow and reuse them on your own web pages, post questions or 
email questions to the author. 
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Common Practice: Jbnice Smith, a history instructor, uses a word processor to write the 
questions for her test (a combination of multiple choice and short essay.) She prints out a 
copy of the master on her printer, takes it to the copy center, and has it photocopied for her 
students. On exam day (a Thursday), she passes it out to students who grab their pencils and 
pens, laboriously write in the spaces provided, and turn them in at the end of the hour. Janice 
then takes them home, reads them (or attempts to read their squiggles!) and marks them up. 
She pulls out her roll book, looks up each name, writes in each score. . : - - 

Next class period (a Tuesday, five days later), she spends half of the class period 
talking about the test — -what problems were most missed? What were they confused about? 
Students who did well on the test are bored and spend the time reading or doodling. Some 
students do not get their questions addressed, as there were no other students missing that 
particular question. 

Marty, a student in her class, doesn 't like taking her tests. His motor skills for writing 
are not good, and without a spell checker his dyslexia makes it very difficult for him to write 
a coherent exam. Alexa, on the other hand, loves the exams. She likes to read the whole 
thing, answer the questions that she knows first, lightly mark in the margin for the ones she is 
not sure of, and then go back and answer them after she finishes the essay section. 

Alternate Practice: Maria Reyes is also a history instructor. She uses a multimedia CBT tool 
for creating her student tests. She not only types in the questions and answers for the multiple 
choice part of her test, but also writes a paragraph explaining why the answer chosen was 
correct or incorrect. She includes a small clip from a video that students saw during class in 
one of her questions which the students must review and then provide a short essay 
describing the context of the clip. She emails it to the campus testing center. On Thursday, 
students are instructed that they must schedule an hour or so in the testing center by Monday 
evening. 

On Tuesday morning, Maria logs into the test center computer, types in her password, 
and reviews the results. She prints out the essay answers and reads them over, marking them 
with her pen (she prefers to do it this way rather than reading them on the computer.) She 
inputs her scores for the student essays into the software, then prints the score summary for 
the exam, noting which questions were most often missed. Out of curiosity, she also prints 
out a report which shows the average amount of time for each question that was taken, and is 
surprised to see that one essay question required two thirds of the average test taking time. 
Because she did not specify a time limit, she sees that student completion times ranged from 
1 8 minutes to almost two hours. In class, she talks for a few minutes about the essay question 
that took so long and hands back the essay portion of the test. 

Anita, a student in Maria ’s class, doesn ’t like on-line tests. She never really liked ■ 
computers, anyway, She feels discouraged when the computer tells her that she got an 
answer wrong. Jose, on the other hand, really likes these tests. He just learned how to type 
(sort of), but even though he is new to computers he thinks it is fun. And, he likes it that he 
can take his time to carefully read and think about the questions. He is still learning English, 
and having time to really think and compose answers really helps him. 
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On-line Assessment: What, Why, How 



What is on-line assessment? 

Recent advances in computer technology have led to a revolution in the way that 
information is disseminated, accessed, and used in business and leisure activities. As these 
technologies become available in the community college system, some teaching and learning 
activities can also be made more efficient and effective. 

One component of teaching that has undergone little change over the years is student 
assessment. In general, instructors still make up their tests shortly before exam time, 
reproduce the tests, and pass them out to students. Class time is required for students to take 
the test, and students are limited to a certain amount of time. Instructors then collect the 
exams, laboriously grade them, mark the scores in their grade books (usually by hand), and 
then tally scores at the end of the term to assign grades. Modem technology plays little part 
in this process; perhaps the instructor includes some diagrams or pictures in the test that 
would have been difficult to include prior to use of word processors, and perhaps the teacher 
enjoys increased productivity in developing tests but using copies of the previous version of 
the test as a starting point. The most technologically liberated instructors may even use a 
grading program or a spread sheet to keep track of scores, but the amount of time used for 
grading, record keeping, and reviewing tests with students has changed very little over the 
last 1 5 years. 

On-line assessment techniques — administering tests through computer technology 
over the Internet or a local area network (LAN) — offer teachers and students more effective, 
efficient means of administering, tracking, and taking of tests. 

Background of on-line assessment 

On-line testing has only been possible (in a practical sense) for a few years, although 
the ideas have been around for some time now. Recent developments which have made on- 
line testing feasible include the increased speed and power of modem computers, 
accessibility of the Internet and/or LANs on campuses, libraries and homes, availability of 
low cost computer systems, acquisition of technology by schools, student prior experience 
with technology, and the availability of easy to use software for on-line test development. 

On-line testing and distance education courses 

The concept of on-line testing is currently being addressed by many instructors and 
colleges for the distance education courses they are offering. I conducted an informal survey 
of colleges offering distance education courses to see what policies are now in place or being 
discussed and found various models being used: 

• Authorized Testing Centers — many distance education courses which rely strongly on 
computer technologies for course delivery and interaction have students attend an 
authorized testing center where they can be proctored during testing (on-line or pencil 
and paper tests.) 

• On-line testing — other instructors offer students tests which they can take online (un- 
proctored) 

• Less formal assessment — one means of getting around the problems associated with 
testing students that are not on campus is the use of other, alternative forms of assessment 
(portfolios, participation in online discussion groups, etc.) 
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On-line testing for college courses physically attended by students 

Examples of on-line testing in other college courses are difficult to locate. A literature 
search as well as Internet searches turned up little, and although I attempted to collect a 
sample of sites from the Internet, I had little luck. Undoubtedly, there is on-line testing being 
conducted in various courses, but such testing may not be widely “advertised.” 

As the instructor of a multimedia authoring course at Allan Hancock College, I have 
been conducting on-line tests with students for the last term using a variety of software tools 
to develop the tests. The construction of the tests are explained in more detail later in this 
paper, and will be demonstrated during my talk. I give my students weekly quizzes, and I use 
the results of the quizzes to identify areas of teaching that have not been as clear as they 
should have been. Each quiz is graded, and students are required to take each quiz each 
week, but only the fact that the test was taken is used in grading (not the actual score.) My 
intent was to research the acceptance of this testing, experiment with different methodologies 
for developing and administering tests, and compare the time and effort required to develop 
and administer these tests in comparison to the “normal” pencil and paper tests. 

With the student population that I am working with — mostly graphic arts students 
who want to learn about multimedia — I knew that I would not need to be concerned about the 
students’ ability to use computers. The nature of the course required them to have already 
mastered basic competencies with the computer (typing, using the mouse, understanding 
what to click on, etc.) I also required them to use a message board system that I established 
for the class (logging in at least once per week and posting a message.) This component of ■: 
the course was designed to help students gain the skills they would need to be successful 
doing multimedia (understanding of newsgroups, how to post messages, how to reply to • 
postings, how to obtain product information, etc.) 

In my class of 26 students, all but five had Internet access from their homes or offices 
(most of my students work.) Of the five without computers or Internet access, all but one 
were able to access the Internet from a friend’s house, the school library, or the public 
library. All students had email addresses (two obtained them after the term started.) Only 
seven students had used newsgroups prior to the class. None of the students had had on-line 
testing in any other course. 

Computerized Adaptive Testing (CAT) 

One field of on-line testing, known as “computerized adaptive testing” has been used 
in educational research since the 1970’s but is still not widely used in schools or testing 
centers. I do not advocate that teachers develop CAT, due to the complexities of scoring and 
programming they entail. However, I present the concept in this paper for those interested in 
learning about it, and especially for administrators that may be interested in the concept for 
larger testing environments. 

Adaptive testing means that the sequence of test questions presented to each student 
and the questions themselves will vary because they are based on responses to prior test 
questions. Each question is automatically chosen to yield maximum information about the 
examinee, based on the skill level indicated by the examinee's answers to previous questions. 
Although fewer questions are presented for each test than would be given. in a paper-and- 
pencil test, accuracy is maintained. 

According to the Educational Testing Service (ETS), “students are tested more 
quickly, even though the tests are untimed, and are not frustrated or bored by questions that 
are too hard or too easy. The difficulty of the questions is quickly and automatically adapted 
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